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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 23 October 2006 have been fully considered but they 
are not persuasive. 

In re page 7, Applicant's Representative states: "the sequentially-accessed 
bookmarks displayed as vertical bars on a trick play bar are not 'a mosaic 
representation of the program segments of the stored portion of the audiovisual data 1 as 
recited by Claim 1." 

The Examiner respectfully disagrees. The term "mosaic" as defined by 
Webster's Collegiate Dictionary, tenth edition, page 756, as "a surface decoration made 
by inlaying small pieces of variously colored material to form pictures or patterns; 
something resembling a mosaic." As such, the term does not specify any particular 
pattern beyond discrete elements displayed over an area, and is quite broad. Brown 
explicitly discloses a display of discrete elements both as noted in the non-final rejection 
and further in figures 18, as referenced by the cited passage. 

In re page 8, Applicant's Representative states: "Brown does not disclose 'a grid 
generator to configure ... the information regarding the program segments of the stored 
portion of the audiovisual data, ... the information provided to the user ... in grid format 
with a plurality of grid elements,' as recited by Claim 14." 



Application/Control Number: 09/877,632 Page 3 

Art Unit: 2621 

The Examiner respectfully disagrees. In addition to the cited disclosure, Brown 
also discloses a grid-based display of recorded programs in Fig. 17, with full description 
of that display in Col 14, lines 42-62. 

In re page 9, Applicant's Representative states; "Brown does not disclose 
'displaying to the user the information regarding the program segments of the stored 
audiovisual data in a mosaic representation,' as recited by amended Claim 23." 
The Examiner again respectfully disagrees, for reasons cited above. 
Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

3. Claims 1-14 and 16-37 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Brown et al (6,868,225). 

Regarding claim 1, Brown et al disclose an audiovisual system comprising: 

• a system controller (Fig. 1 , CPU 106); 

• a storage device to store the portion of the audiovisual data and to play back 
the stored portion of the audiovisual data (Fig. 1, Hard Disk 105); 

• a marking module to create metadata in response to a control input for 
marking the programs segments comprising information regarding the 
program segments of the stored portion of the audiovisual data (Col 3, lines 
58-59 "Bookmarks are stored [and] retrieved for the user"); 
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• a display generator to generate a mosaic representation of the program 
segments of the stored portion of the audiovisual data (Col 15, lines 43-44 
"The invention places an indicator 1808 on the screen, indicating that a 
bookmark has been saved" and Col 20, lines 8-9 "index or bookmark 
indicators are displayed over the trick play bar"); and 

• a program selector to select a program segment of the stored portion of the 
audiovisual data in response to a user input based on the information of the 
metadata, enabling the user to jump to and play back selected program 
segments of the plurality of programs (Col 15, lines 44-45 "The user can, at 
any time, access any of his bookmarks and continue viewing the program 
from the bookmark"). 

Regarding claim 2, Brown et al disclose an audiovisual system comprising a 
personal video recorder (TiVo, the assignee, is known as a manufacturer of PVRs). 

Regarding claim 3, Brown et al disclose an audiovisual system wherein the 
storage device comprises a read/write, random-access, non-volatile storage media (Fig 
1, Hard Disk 105). 

Regarding claim 4, Brown et al disclose an audiovisual system wherein the 
metadata comprises user-generated modifications to pre-existing metadata (Col 5, lines 
47-52 "when the parser 401 sees a private data event, it directs the byte stream to the 
private data DMA engine 404 and directs an event to the event buffer 413. The Media 
Switch notifies the program logic via an interrupt mechanism when events are placed in 
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the event buffer" and Col 1, lines 53-55 "The system allows a user to save and retrieve 
bookmarks for several audio and/or video programs on a single device"). 

Regarding claim 5, Brown et al disclose an audiovisual system wherein the pre- 
existing metadata is received by the audiovisual system with the audiovisual data (Col 
6, lines 65-67 "The demultiplexer multiplexes the extracted audio, video and private 
data channel streams through the video input Media Switch port"). 

Regarding claim 6, Brown et al disclose an audiovisual system wherein the 
metadata is stored subsequently to the storing of the stored portion of the audiovisual 
data by the audiovisual system (Col 1 , lines 58-60 "a bookmark function that allows the 
user to bookmark a program where he left off'). 

Regarding claim 7, Brown et al disclose an audiovisual system comprising a 
preference determination module, and wherein the control input comprises signals from 
the preference determination module (Col 14, lines 50-52 "The system's list is based 
upon the program preferences that the user has expressed to the system using the 
thumbs up and thumbs down ratings"). 

Regarding claim 8, Brown et al disclose an audiovisual system wherein the 
metadata comprises information indicating a level of interest by a user in the program 
segment starting from the corresponding program location (Col 14, lines 50-52 "The 
system's list is based upon the program preferences that the user has expressed to the 
system using the thumbs up and thumbs down ratings"). 

Regarding claim 9, Brown et al disclose an audiovisual system wherein the 
metadata comprises information indicating a category of the program segment starting 
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from the corresponding program location (Col 23, lines 20-22 "The program guide 
information is sorted in different ways, e.g., all movies 2901, favorite channels 3001, all 
channels 3101, all sports, etc."). 

Regarding claim 10, Brown et al disclose an audiovisual system wherein the 
category comprises the genre of the program segment starting from the corresponding 
program location (Col 23, lines 20-22 "The program guide information is sorted in 
different ways, e.g., all movies 2901, favorite channels 3001, all channels 3101, all 
sports, etc."). 

Regarding claim 11 , Brown et al disclose an audiovisual system wherein the 
metadata comprises information indicating an identity of a user (Col 2, lines 1-2 
"Bookmarks within a single program can be set for different users"). 

Regarding claim 12, Brown et al disclose an audiovisual system wherein the 
mosaic representation comprises a plurality of cells, at least one cell comprising a fixed 
image (Col 13, lines 65-67 "Any temporal elements [e.g., names, icons, location 
indicators] are drawn onto the screen over the video loops"). 

Regarding claim 13, Brown et al disclose an audiovisual system wherein the 
mosaic representation comprises a plurality of cells, at least one cell comprising a video 
image (Col 5, lines 39-40 "when the parser 401 finds a video event, it directs the stream 
to the video DMA engine 402"). 

Regarding claim 14, Brown et al disclose an audiovisual system which provides 
to a user information regarding the program segments of the stored portion of the 
audiovisual data (Col 21, lines 23-27 "the invention displays a program guide area 2801 
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to the user which is a list of the programs that are currently airing, was aired, or is 
scheduled on live TV") comprising: 

• a storage device to store and play back a portion of the audiovisual data (Fig. 
1 Hard Disk 105); 

• a grid generator to configure for the user display the information regarding the 
program segments of the stored portion of the audiovisual data, the 
information derived from metadata corresponding to the program segments of 
the stored portion of the audiovisual data, the information provided to the user 
via the user display in grid format with a plurality of grid elements (Col 21 , 
lines 46-48 "The invention displays the program guide information in two 
different modes: two column or three column"), each grid element 
representing a program segment of the stored portion of the audiovisual data 
(Col 21, lines 27-29 The CPU 713 parses the program guide information and 
creates program schedule information"); and 

• a program selector to select a grid element that represents a selected 
program segment of the stored portion of the audiovisual data in response to 
user input, the selected program segment selected based on the information 
derived from the metadata, whereby the audiovisual system selectively plays 
back selected programs of the stored portion of the audiovisual data starting 
from selected program locations, thereby enabling a user to jump to and play 
back selected program segments of the plurality of programs (Col 15, lines 
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44-45 "The user can, at any time, access any of his bookmarks and continue 
viewing the program from the bookmark"). 

Regarding claim 16, Brown et al disclose an audiovisual system wherein at 
least one grid element comprises an icon which is representative of the program 
segment represented by the grid element (Fig. 24). 

Regarding claim 17, Brown et al disclose an audiovisual system wherein at 
least one grid element comprises text which is representative of the program segment 
represented by the grid element (Fig. 24). 

Regarding claim 18, Brown et al disclose an audiovisual system wherein the 
plurality of grid elements are chosen for display based on the metadata of the 
corresponding program segments of the stored portion of the audiovisual data (Col 23, 
lines 20-22 "The program guide information is sorted in different ways, e.g., all movies 
2901 , favorite channels 3001 , all channels 3101 , all sports, etc."). 

Regarding claims 19 and 21, Brown et al disclose an audiovisual system 
wherein the plurality of grid elements comprises grid elements chosen for display based 
on a second and third user input (Col 16, lines 12-14 "Specific remote controls] can be 
set up so that different levels of parental controls are engaged for each remote control"). 

Regarding claim 20, Brown et al disclose an audiovisual system wherein the 
plurality of grid elements are organized within the grid format in response to the 
metadata (Col 23, lines 20-22 "The program guide information is sorted in different 
ways, e.g., all movies 2901, favorite channels 3001, all channels 3101, all sports, etc."). 
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Regarding claim 22, Brown et al disclose an audiovisual system wherein the 
plurality of grid elements are organized within the grid format based on the program 
from which each program segment is derived (Col 23, lines 20-22 'The program guide 
information is sorted in different ways, e.g., all movies 2901, favorite channels 3001, all 
channels 3101, all sports, etc."). 

Regarding claim 23, Brown et al disclose a method of playing back selected 
portions of stored audiovisual data stored on a storage device comprising: 

• providing stored audiovisual data corresponding to a plurality of programs, 
each program comprising a plurality of program locations, each program 
location representing a starting point of a program segment of one of the 
plurality of programs (Col 16, lines 51-60 'The user can rotate through three 
different levels of banners, each successively containing more information 
about the program. The lowest level banner 2001 contains minimal 
information such as channel 2002, station ID 2003, and time 2004. The 
second level banner 2005 displays, in addition to the information in the 
minimal banner 2001 , information such as program title 2006, duration 2007, 
program MPAA or TV rating 2008, and thumbs rating. The final level banner 
2009 adds program text description 2010 to the second level banner 2005"); 

• creating metadata in response to a control input for marking the program 
segments comprising information regarding the program segments of the 
stored audiovisual data (Col 15, lines 35-38 "a user can watch the first half- 
hour of a two-hour program stored in the storage device 710 and then 
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bookmark the program where he left off or he can place bookmarks within the 
program to mark points of interest" and lines 53-54 "A bookmark is placed in 
the same manner by pressing the select button 1406 to create a bookmark"); 

• displaying to a user the information regarding the program segments of the 
stored audiovisual data (Col 15, lines 42-44 "The invention places an indicator 
1808 on the screen, indicating that a bookmark has been saved"); 

• receiving a user input indicating a selected program segment of one of the 
plurality of programs based on the information of the metadata (Col 15, lines 
50-52 "the user can jump to a bookmark using the jump button 1414 on the 
remote control 1401" and Col 15, lines 44-45 "The user can, at any time, 
access any of his bookmarks and continue viewing the program from the 
bookmark"); and 

• playing back the selected program segment starting from the corresponding 
program location of the stored audiovisual data, thereby jumping to and 
playing back selected program segments of the plurality of programs based 
on the metadata (Col 15, lines 44-45 "The user can, at any time, access any 
of his bookmarks and continue viewing the program from the bookmark"). 

Regarding claim 24, please refer to Examiner's comments regarding claim 4. 
Regarding claim 25, please refer to Examiner's comments regarding claim 7. 
Regarding claim 26, please refer to Examiner's comments regarding claim 14. 
Regarding claim 27, please refer to Examiner's comments regarding claim 15. 
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Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claim 15 is rejected under 35 U.S.C. 103(a) as being unpatentable over Brown at 
al as applied to claims above, and further in view of Yuen (6,240,241) 

Regarding claim 15, Brown et al disclose an audiovisual system wherein at 
least one grid element comprises an image (Figs 22 and 24), but do not specifically 
disclose that the image is extracted from the program segment represented by the grid 
element. 

Yuen teaches using representative images selected from the program in an index 
to help the user identify the program he is selecting (Col 1 , lines 46-48 "A frame of the 
video program that is recorded on tape is selected to be displayed with the directory in 
text form for one or more of the recorded programs"). 

As suggested by Brown and taught by Yuen, using an image from a file in an 
index is well known and commercially available, providing the user with a more useful 
index entry. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify Brown in order to provide a representative image icon in 
the index grid. 
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Conclusion 

6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James A. Fletcher whose telephone number is (571) 
272-7377. The examiner can normally be reached on 7:45-5:45 M-Th, first Fridays off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, James Groody can be reached on (571) 272-7950. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-91 99 (IN USA OR CANADA) or 571-272-1 000. 



JAF 

7 November 2006 
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